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1.  Introduction.  Solving  mathematical  optimization  involving  equilibrium  con¬ 
straints  is  generally  challenging  and  the  design  of  solutions  procedures  to  deal  with 
such  problems  when  the  equilibrium  constraints  involve  set-valued  stochastic  map¬ 
pings  brings  along  a  new  level  of  difficulty.  This  article,  considers  a  particular  case 
which  enables  us  to  deal  with  a  specific  instance,  see  §4,  of  the  ‘inverse’  problem  in 
micro-economics:  given  that  prices  and  the  decisions  of  the  agents  can  be  observed, 
is  it  possible  to  infer  their  utility  functions? 

Specifically,  we  consider  the  following  mathematical  program  with  stochastic  e- 
quilibrium  constraints  (MPSEC): 

/,  min2,gx  \{x,Hx)  +  {c,x) 

subject  to  AtE[5't(|,x)]  9  6t,  t=l,...,T, 

where  c  €  IR^,  At  €  IR™^”,  bt  €  IR™,  i/  is  a  positive  semi-definite  x  matrix, 
X  C  IR'^  is  a  compact  set  and  ^  :  fl  —>■  E  C  IR^  is  a  random  vector  with  realizations 
as  ^  (without  boldface)  and  (5,  J",  P)  the  induced  probability  space, 

(1.2)  St(^,x)  =  argmaxj^  {  {y,uti^,x))  \{e,y)  <1,  j/  >  0}  C  ]R”, 
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Mt  :  S  X  — >■  ]R"  is  a  given  continuous  function,  and  e  =  (1, . . . ,  1)  G  IR”,  and 

E[S't(^,a;)]  =  {E[s(^,a:)]  |s(^,a;)  G  St{^,x),  s{-,x)  P-summable  selection  of  5t(-,a;)} 

is  Aumann’s  expected  value  [1]  with  respect  to 

This  problem- type  (1.1)  is  part  of  an  important  family  of  problems  in  economics 
which,  in  particular,  includes  the  pure  characteristics  demand  model  which  seeks  to 
estimate  the  parameters  in  the  consumers’  utility  function  [3,  10,  14].  In  such  a 
model,  the  constraint  AtE[5't(4,  x)]  9  bt,  with  At  the  identity  matrix,  represents  the 
market  share  equations,  Ut  determines  the  consumer’s  utility  in  market  ‘t’  and  the  jth 
component(s)  of  the  solution(s)  in  St{^,  x)  of  (1.2)  is  the  probability  that  the  consumer 
purchases  product  j  in  market  t  given  the  observed  environment  The  linear  program 
(1.2)  models  the  consumer’s  decision  choice,  in  market  t,  to  acquire  the  product 
or  products,  that  yields  the  highest  utility  given  environment  The  variable  x 
consists  of  two  parts  x^  G  IR'^^  and  G  IR*^^ :  x^  describes  the  product  characteristics 
or  demand  shock  that  is  observed  by  the  providers  (firms)  and  consumers,  but  not 
explicitly  available  in  the  data,  and  x^  models  the  consumer’s  preferences  or  taste  for 
the  observed  product  characteristics  and  its  price.  The  pure  characteristics  demand 
model  is  to  estimate  x^  and  minimize  the  demand  shock  or  error  x^.  The  objective 
function  in  this  model  has  H  =  diag(i?i,  H2)  and  c  =  0,  where  Hi  is  a  x  i^i  positive 
definite  matrix  and  H2  is  the  V2  x  1^2  zero  matrix. 

There  are  quite  a  number  of  challenges  one  has  to  deal  with  to  solve  such  a 
problem.  To  begin  with  the  solution  of  (1.2),  for  any  fixed  (C, x)  is  not  necessarily 
unique,  in  fact,  in  general,  it’s  set-valued.  Consider  a  simple  example  with  Ut{^,x)  = 
(^1  -I-  X,  ^2)  G  IR^,  where  G  IR  and  ^2  >  0.  The  solution  set  has  the  form 

f  (1,0)  x>^2-^i, 

St{i,x)=<  {(a,  1  -  a)  I  a  G  [0, 1]}  x  =  ^2-^i, 

[  (0,1)  6 -Cl¬ 

one  cannot  find  a  single- valued  function  s(C,  x)  G  5't(C,  x)  which  is  continuous  with  re¬ 
spect  to  X.  The  use  of  a  sample  average  approximation  (SAA)  scheme  to  approximate 
the  market  share  equations  as  proposed  in  the  existing  literature  becomes  intractable. 
Another  major  difficulty  comes  from  the  fact  that  all  solution  sets  S't(C,  x),  t  =  1, . . . ,  T 
also  share  the  same  x- variables. 

Market  share  equations  play  an  important  role  in  economics  [3,  10,  14].  The  ‘in¬ 
verse’  problem,  from  consumers  choices  evince  their  utility  functions  is  a  fundamental 
issue  in  economics.  In  the  pure  characteristics  demand  model,  even  when  approximat¬ 
ing,  the  market  share  equations  for  the  unobserved  product  characteristics,  finding 
best  estimates  by  relying  on  a  nested  fixed-point  approach  has  been  proposed  in  the 
existing  econometrics  literature  but  it  is  known  that  such  an  approach  is  computa¬ 
tionally  ineffective.  Recently,  Pang  et  al.  [14]  proposed  a  mathematical  programming 
with  linear  complementarity  constraints  (MPLCC)  approach  for  the  pure  character¬ 
istics  demand  model  with  a  finite  number  of  observations  i  =  Their 

approach  provides  a  promising  computational  method  to  estimate  the  consumer  util¬ 
ity  under  the  additional  condition  that  in  any  market  t,  the  optimal  choice  of  each 
individual  consumer  is  guaranteed  to  purchase  just  one  single  product  in  each 
environment.  They  rely  extensively  on  this  property  of  the  (basic)  optimal  solution  of 
(1.2)  in  their  development.  This  condition  and  the  use  of  such  basic  solution  with  a 
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finite  number  of  observations  i  =  1, . . . ,  for  (1.1)-(1.2)  can  be  expresses  in  terms 

of  the  following  mathematical  program  with  linear  equilibrium  constraints 

(1.3) 

mina;gx  \{x,Hx)  +  {c,x) 

subject  to  9  f  G  S,  i 

where 


St{£„x)  =  {argmin||s||o  |  s  G  S't(^,a;)}, 

here  ||s||o  denotes  the  number  of  nonzero  entries  of  s.  With  the  constraints  (e,t/)  <  1 
and  y  >  0,  clearly,  the  linear  program  (1.2)  has  always  a  basic  optimal  solution 
s(^,x)  and  it’s  taken  for  granted  that  any  basic  optimal  solution  has  just  a  single 
variable  taking  on  the  value  1  while  all  others  are  0  when  maxi<i<„  Mi(^,  x)  >  0. 
One  could  refer  to  a  solution  of  this  type,  s{^,x)  G  St{^,x)  as  a  ‘sparse  solution’  of 
(1.2).  However,  the  use  of  such  ‘sparse  solutions’  raises  questions  when  there  is,  in 
fact,  a  multiplicity  of  solutions.  For  example,  when  x))j  =  maxi<i<„(Mj(^,  x))i, 

j  =  1,2,3,  why  would  the  probability  that  a  consumer  purchases  one  of  the  three 
products  be  1  and  0  for  the  two  others?  Should  the  choice  probability  not  be  1/3, 
for  example,  for  each  one  of  the  three  products?  Other  question  arise  about  the 
consistency  of  the  solutions  of  the  MPLCC  problem  (1.3)  to  the  given  problem  (1.1) 
as  the  sample  size  N  goes  to  infinity. 

Motivated  by  the  MPLCC  approach  [14]  and  the  preceding  questions,  we  refor¬ 
mulate  problem  (1.1)  as  the  following  mathematical  program  with  stochastic  linear 
complementarity  constraints  (MPSLCC) 

,  .  miTL^(zx  \{x,Hx)  +  {c,x) 

subject  to  HtE[S't(|,  x)]^  bt,  t  =  I, . . . ,  T, 

where  St{^,x)  consists  of  all  the  solutions  to 

,  .  0  <  y{^,x)  ±  -uti^,x) +  'y{^,x)e  >0 

0  <  7(C,a;)-L  l-{e,y{^,x))  >0 


for  some  7(^,2;)  G  IR  or,  equivalently,  the  linear  complementarity  problem  (LCP): 


_L  M 


(1.6)  0  < 

with  the  positive  semidefinite  matrix 

M  = 


+ 


1 


>  0 


0  e 
-e  0 


G  IR' 


(n-l-l)x(n-l-l) 


For  fixed  {t,^,x)  and  with  qt{^,x)  =  {—Ut{^,x),  1)  G  IR"^^,  let’s  denote  the  comple¬ 
mentarity  problem  (1.6)  by  LCP{qt{^,x),  M)  and  by 

S{qt,  M)  =  {s  G  IR"  I  for  some  7  >  0,  (s,  7)  solves  LCP(gt(^,  x),  M)}, 
i.e.,  the  solution  set  projected  on  the  s-space^. 

^To  lighten  up  the  notation,  when  no  confusion  is  possible,  we  usually  simply  write  qt  instead  of 
the  more  precise,  but  cumbersome,  qt(^,x). 
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It  will  be  shown  that,  cf.  proof  of  Theorem  2.3,  the  solution  set  S{qt,M)  is 
bounded.  With  M'^  =  M  +  el,e  >  0,  it  also  implies  that  the  LCP(gt(^,  x),  M®)  has 
a  unique  solution,  which  is  then  denoted  by  zf  =  (sf,7f).  It  converges  to  the  least 
norm  solution  of  the  LCP((7t(^,  x),  M)  as  £  0  [8,  Theorem  5.6.2].  Moreover,  for  any 

fixed  £  >  0,  the  function  qt  i— zf  is  globally  Lipschitz  continuous  (with  qt  =  qt{i,x)) 
and  continuously  differentiable  at  qt  if  and  only  if  for  no  j,  (zf)j  =  0  =  (Mzf  +  qt)j 
[6], [7,  Lemma  2.1];  a  nondegenerary  condition.  These  engaging  properties  motivate 
us  to  consider  a  regularized  version  of  MPSLCC:  with  zf  the  unique  solution  of  the 
regularized  LCP((7t(^,  x),  M^) 


(1.7)  0  <  z^-M^ z  +  qt{^,x)  >0,  where  qt{^,x)  = 


-ut{^,x) 

1 


the  formulation  of  our  problem  becomes 

(1.8) 


\{x,Hx)  +  {c,x) 

subject  to  ll£ltE(sf(^,x)]  -  hW  <  r{e), 


and  the  SAA-version  of  the  regularized  MPSLCC 


(1.9) 


min2,gx  ^{x,Hx)  +  {c,x) 

subject  to  -btW  <r{s,N),  t  = 


,T, 


where  r{e)  j,  0  as  £  j,  0,  f{e,  N)  — >•  r{s)  as  N  ^  oo  for  any  Hxed  £  >  0. 

The  advantage  of  working  with  (1.8)  and  (1.9)  is  that  one  can  replace  the  set¬ 
valued  mapping  by  a  single  valued  function.  Problem  (1.9)  is  a  mathematical  program 
with  a  convex  quadratic  objective  function  and  globally  Lipschitz  continuous  inequal¬ 
ity  constraints.  Moreover,  we  can  have  a  closed  form  for  z^ ,  see  Lemma  2.2.  The  main 
contribution  of  this  paper  is  to  propose  an  efficient  approach,  via  the  SAA-version  of 
the  regularized  MPSLCC,  to  find  a  solution  of  the  mathematical  program  with  sto¬ 
chastic  equilibrium  constraints  (1.4)  and  to  show  that  a  sequence  of  solutions  {x|^}  of 
the  SAA  regularized  stochastic  MPSLCC  (1.9)  converges  to  a  solution  of  the  (given) 
problem  (1.4)  as  A^  — >■  oo  and  £  j,  0. 

In  Section  2,  we  derive  various  properties  of  the  solution  functions  sf  and  their 
convergence  to  the  solution  set  St{^,  x)  as  £  j,  0  and  x  — >■  x.  In  particular,  we  provide  a 
closed  form  of  the  solution  functions  which  is  used  to  prove  the  graphical  convergence 
of  the  real-valued  function  sf  to  the  set-valued  mapping  S't(-).  In  Section  3,  we  prove 
the  existence  of  solutions  to  the  MPSLCC  (1.4)  and  the  SAA  regularized  MPSLCC 
(1.9).  We  show  that  any  sequence  of  solutions  of  (1.9)  has  a  cluster  point  as  £  j,  0  and 
N  — >■  oo,  and  that  any  such  cluster  point  is  a  solution  of  the  MPSLCC  (1.4)  (a.s.).  In 
Section  4,  we  use  the  pure  characteristics  demand  model  to  illustrate  the  MPSLCC 
(1.4)  and  the  SAA  regularized  method. 

Throughout  the  paper,  jj  •  j]  stands  for  the  £2  norm,  e  denotes  the  vector  whose 
elements  are  all  1,  \J\  is  the  cardinality  of  a  set  J  and  denotes  the  vector  whose 
components  (u+)i  =  max(0,  Ui),  i  =  1,  -  ■  ■  ,n. 

2.  Solution  function  of  the  regularized  LCP.  Let’s  now  concern  ourselves 
with  the  properties  of  the  function  sf  generated  from  the  solution  of  LCP((7t(^,  x),M^). 

Lemma  2.1.  Problems  (1-1)  and  (1-4)  equivalent. 


4 


Proof.  The  LCP  (1.5)  consists  exactly  of  the  KKT-conditions  for  (1.2)  with 
solution  sf  if  and  only  if  =  (sf,7f)  is  a  solution  of  (1.5)  for  some  yf  >  0.  □ 

For  simplicity’s  sake,  in  the  remainder  of  this  section,  we  concentrate  on  the 
‘solution’  function  z®  =  (s®,7®)  generated  by  the  regularized  linear  complementarity 
problem  LCP(<7t,M®)  with  qt  :=  G  for  fixed  t,  f  and  x;  in  this 

section,  we  drop  making  reference  to  these  quantities  to  simplify  notations  and  the 
presentation.  Our  hrst  aim  will  be  to  show  that  for  given  u,  s‘^{q)  and  z‘^{q)  are 
uniquely  determined  and  even  comes  with  a  closed  form  expression.  Note  that  Ui  = 
—qi,  i  =  1,  -  ■  ■  ,n  and  qn+i  =  1,  and  we  have 

ll(-9)+lli  =  -  XI  =  XI  =  ll^^+lli- 

Ui>0 


Lemma  2.2.  Given  e  >  0,  the  funetion  z^  is  uniquely  determined  by  the  solution 
of  the  regularized  LCP{q,  M^)  and  is  eompletely  described  as  follows: 

Let  qki  <  qk2  <  ■  ■  ■  <  9fc„ :  set 


Olj  =  -  X '=1  J  =  1:  •  •  • )  « 

J 

and  J  =  {j \aj  <0,j  =  1,. . .  ,n},  J  =  \J\,  u  =  X  ■ 

i=l 

(a)  If  \\{—q)+\\i  >  s,  the  solution  (5^,7^)  of  the  LCP(q^M^)  has  the  form 


(2.1) 


’  (7-{J^€^)qkj  +e 


^/  j(^J, 

*/  j^J, 


7" 


—a  —  s 
J  +  s^' 


(h)  If  II (— 9)+ 111  <  £,  the  solution  takes  the  form 


(2.2)  for  j  = 


if 

if 


dkj  <  0, 
dkj  >  0, 


=  0. 


(0  If  ll(-g)+lli  =  e,  a  =  -||(-q')+||i  and  J  =  {j\  qkj  <  0,  j  =  1, . . . ,  n},  that  is, 
formulas  (2.1)  and  (2.2)  are  consistent. 

Moreover,  in  all  cases,  ^  +  ^ll(~g)+lli- 

Proof.  Let  =  (s^,j^),  i.e.,  the  solution  (vector)  of  LCP(g,M^).  Without  loss 
of  generality,  assume  qi  <  q2  <  ■  ■  ■  <  qn,  i.e.,  kj  =  j. 

(a)  ||(— <z)+||i  >  e:  We  show,  first,  that  ior  j  G  J:  >  0  and  {M^z^)j  +  qj  = 

es|  +  7*^  +  qj  =  0.  From  aj  <  0,  j  <  J,  qj  —  qj  >  0,  and  aj  <  0,  we  have 

( Je  +  e^)s|  =  CT  -  ( J  +  e^)qj  +  e  +  aj  -  aj  =  {J  +  e^){qj  -  qj)  -  aj  >  0 
(J  +  e^){£s)  +  7^  +  qj)  =  a  -  {J  +  £^)qj  +  e-  cr-e  +  (J  +  e^)gj  =  0. 

The  next  step  is  to  show  that  {M^z^)j  +  qj  =  7^  +  >0  when  j  ^  J.  By  the 

definition  of  J  and  J,  one  has  aj+i  >  0,  j  >  J  +  1  and  qj  >  qj+i-  Hence, 

(2.3)  (J  +  e^)(7‘^  +  qj)  =  —u  —  £  +  ( J  +  £^)qj  —  oj+i  +  cij+i 

=  —<x  —  £  +  ( J  +  £^)qj  +  (cr  +  qj+i  —  ( J  +  1  +  e^)qj+i  +  £)  +  aj+i 
=  (J  +  £^){qj  —  qj+i)  +  aj+i  >  0. 
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Finally,  we  show  that  7“^  >  0  and  {M^z^)n+i  +  1  =  1+  £7^  —  Yl'i=i  =  0-  Let 
jo  =  inax{j  I  (7j  <  0};  such  an  index  is  guaranteed  to  exist  since  ||(— (7)+||i  >  £• 
Actually,  we  are  going  to  establish  that  qj  <  0  for  all  j  G  J .  Assume  for  contradiction 
purposes  that  qj  >  0  for  some  j  G  J.  Of  course,  then  j  >  jo  and 

jo  j 

aj  =  -^g*-£+  te-9*)  +  (jo+e^)gi 

i—1  i—jQ-\-l 

j 

=  ||(?+||i-£+  iij  -  qi)  -  Uo  +  £^)qj  >  0, 

i=jo  +  l 

which  contradicts  the  definition  of  Hence,  qj  <  0  for  j  G  which  together  with 
||(-g)+||i  >  £  implies  0  <  -ct  <  ||(-9)+||i. 

Let’s  now  show  that  —a  >  e.  Note  that  gj  <  0,  j  =  1, . . . ,  J  and  J  <  jo-  If  jo  =  J, 
then  by  definition  of  jo,  one  has  —a  =  ||(— (z)+||i  >  £•  If  jo  >  J,  from  qj+i  <  0  and 

Q^j+i  =  —^i^iqi  —  £  —  qj+i  +  q.j+1  +  {J  +  s'^)qj+i 

=  -a  -  s  +  {J  +  £^)qj+i  >  0, 


and,  thus,  — cr  >  £.  Moreover,  qi  =  ^  yields  ~ 

n 

{Js  +  £^)(l  +  £7^  —  ^  sf)  =  J£  +  £^  +  £^(  — CT  —  £)  +  £^CT  —  Js  =  0. 

i=l 

Hence,  the  solution  has  the  explicit  form  (2.1). 


(b)  ||(— (?)+||i  <  £:  If  ||(— <7)+||i  =  0,  then  g  >  0  and  (2.2)  holds  with  z®  =  0.  If 
||(-g)+||i  >  0,  then  jo  >  1.  For  j  <  jo,  =  -q^je  >  0,  7^  =  0  and 

{M'^z'^)j  +  qj  =  £Sj  +  7^  +  qj  =  -qj  +  qj  =  0. 

For  j  >  jo,  one  has  qj  >  0,  =  0,  7®  =  0  and  {M^z^)j  +  qj  =  eSj  +  7^  +  qj  >  0,  and 

for  j  =  n  +  1,  7^  =  0  and 


(M®z®)„+i  +  1  —  1  +  £7®  —  ^  si 

i=l 


jo 

i  +  (-E  qi)/e  >  0. 


(c)  II (-9)+ 111  =£:  For  j  >  jo, 

jo  j 

Uj  =  -  ^qi-  e+  9*  +  (j  +  £^)9j  >  0, 

i=l  i=jQ  +  l 


and  for  j  <  jo,  aj  =  -  Y.i=i  9i  -  £  +  ( j  +  £^)9i  <  0.  Hence  ct  =  -||(-9)+||i  and 
J  =  {j\qj  ^0}.  Moreover,  in  this  case 


(ct  —  ( J  +  £^)qj  +  s)  /  (+£  +  £^) 

0 


-qj/e 


if 

if 


j  G  J, 


7®  =  — — -  =  0 


J  +  £2 
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which  implies  that  formulas  (2.1)  and  (2.2)  coincide. 

Moreover,  in  case  (a), 

n 

J^^sl<l  +  {e/Jm-q)^h<l  +  e\\{-qUi 

and  X]r=i  1  (b)  which  completes  the  proof.  □ 

The  following  theorem  shows  that  the  unique  solution  z'^(q)  of  the  regularized 
LCP(g,  M^)  is  componentwise  monotonically  convergent  to  the  least  norm  solution  of 
the  hCP{q,M)  with  0{e). 

Theorem  2.3.  Let  z^{q)  =  (q) ,  {q))  be  the  unique  solution  of  the  LCP(q,  M®) 

and  z{q)  =  is{q),j{q))  be  the  least  norm  solution  of  the  LCP(g,M).  Then  for  fixed 
q,  we  have  lim£4,o  ll-2^(9)  —  z{q)\\  =  0.  Moreover,  there  are  positive  constants  s,  ki,  K2, 
such  that  for  any  e  G  (0,£), 

(2.4)  0  <  s^(g)  —  s{q)  <  Kie  and  0  <  7(g)  —  7^(g)  <  K2£- 


Proof.  From  (e,  s{q))  <  1  and  s{q)  >  0,  we  know  that  s{q)  is  bounded.  When 
7(g)  >  0  from  the  complementarity  conditions  one  must  have  1  —  (e,  s(g))  =  0  which 
implies  that  there  has  to  be  an  entry  Sj{q)  >  0  and  7(g)  +  qj  =  0.  Hence,  the  solution 
set  SOL(g,  M)  is  bounded. 

By  [8,  Theorem  3.1.8],  we  know  that  z^{q)  converges  to  the  least  norm  solution 
z{q)  of  LCP(g,  M)  as  e  0  since  the  matrix  M  is  positive  semi-definite. 

If  ||(— g)+||i  =  0,  then  z^{q)  =  z{q)  =  0  for  any  £  >  0.  Hence  (2.4)  holds  for  any 
£  >  0. 

When  ||(-g)+||i  >  0,  let 

(2.5)  CTi  =  min  g,,  172  =  RiiR  Qj}  and  £  :=  min{ - — ^)1}- 

l<j<n  l<j<n  t  —  fT2 

From  ||(— g)+||i  >  0,  there  is  £0  >  0  such  that  ||(— g)+||i  >  — ci  >  £0.  Thus,  for 
any  £  G  (0,£),  ||(— g)+||i  >  £  and  the  solution  z®(g)  has  the  explicit  form  (2.1)  from 
Lemma  2.2  and  (— cti  -I-  cr2)/(l  —  0-2)  <  £0-  Our  next  step  is  to  show  that  aj  <  0  if 
and  only  if  qj  =  ai  for  £  G  (0,£)  which  implies  J'  =  {j  |  g^  =  cri,  j  =  1, . . .  ,n}  and 
cr  =  Jai- 

Without  loss  of  generality  assume  that  gi  <  g2  <  ■  •  •  <  gn-  If  gi  =  cti,  then 
aj  =  —  £  <  0.  Conversely,  when  aj  <  0,  from  the  definition  of  {aj},  one  has 

(2.6)  aj+i  —  Uj  =  — g^+i  -I-  (j  -I-  1  -|-  £^)gj-|_i  —  (j  -I-  £^)qj  =  (j  +  e^){qj+i  —  qj)  >  0. 

Hence,  it  suffices  to  show  that  aj  >  0  for  qj  >02-  If  £  <  1  <  (— Ci  -I-  02) {(ft  —  02), 
then  — CTi  >  1  —  2ct2.  For  qj  >  02,  recalling  02  <  0, 


j 

(2.7)  aj  >  ^(0-2  -  g*)  +  s^a2  -  e  >  0-2  -  ai  +  £^02  -  e>  -cti  -  I  -I-  2ct2  >  0. 

i=\ 
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If  £  <  (-CTi  +  02)1  (1  -  02)  <  1,  then 


02  —  o\ 
\  —  02 


3  _ 

otj  >  V'(ct2  -  qi)  +  £^0-2  -  £  >  CT2  -  (Ti  +  (- - O2  - 


i=l 


(2.8) 


1  —  <72 

02  -  Oi  02  -  Oi  IN  ^  n 

-(1  —  02  +  - - 02  —  1)  >  0. 


1  —  0-2 


1  —  0-2 


Hence,  aj  <  0  if  and  only  if  qj  =  oi  for  any  e  G  (0,£).  By  Lemma  2.2,  for  £  G  (0,£), 
the  solution  z^(q)  of  LCP(q,  M^)  has  the  form 


(2.9)  Z^(q) 


(1  -  £Oi)/(J  +  s^)  if  j  e  J, 
0  if  j  ^  J, 


7^(q)  =  {-J^i  -  s)/{J  +  e^)- 


The  least  norm  solution  of  the  LCP(q,  M)  is  the  minimizer  of  the  quadratic  program 


min2>o  slklP  subject  to  ^  ^  ^3  =  J  ^  -^"+1  =  l"  =  -oi- 

This  least  norm  solution  has  the  form  (cf.  the  first  order  optimality  conditions): 

(2.10)  =  2(9)  = -11' 

From  (2.9)  and  (2.10),  -we  easily  see  that 

0  <  s®((7)  -  Sj{q)  <  (-CTl£)/J^  for  j  =  1,..  .,n, 

and 


0  <  7(9)  -  <  (1  -  cri){£/J)- 

Hence  (2.4)  holds  with  m  =  (— o-i)/J^  and  s;2  =  (1  —  oi)jJ.  □ 

Theorem  2.4.  For  any  fixed  q,  if  \\{—q)+\\i  >  0  then  there  is  e  >  0  such  that  for 
any  e  G  (0,£),  z®  is  differentiable  at  q.  Moreover,  mini<i<„  is  unique  then 

there  exists  £  >  0  and  a  neighborhood  Mq  of  q  such  that  for  any  £  G  (0,  £),  <7  i-G  z’^fq) 
is  linear  on  Mq .  When  z®  is  differentiable  at  q,  one  has 

(2.11)  Vz’^{q)  = -{I  -  D  +  DM^)-^D, 


where  D  is  a  n  x  n  diagonal  matrix  with  diagonal  entries 

_  J  1  lizfiq)  >  0, 

”  1  0  otherwise. 


Proof.  |1(— (7)+||i  >  0  means  there  is  an  £0  >  0  such  that  ||(— 9)+||i  >  —Oi  >  £0. 
Consider  £  G  (0,£)  with  £  as  defined  by  (2.5).  From  (2.9), 

Zj{q)>0,  for  j&J\J{n  +  l} 

and  from  (2.3), 


{M^z^{q)  +  q)^=M{q)+qj>^,  for  j^J. 


Hence  the  strictly  complementarity  condition  holds  at  z'^{q),  that  is,  there  is  no  j  such 
that  z|(g)  =  {M^z^{q)  +  q)j  =  0.  Differentiability  of  at  q  follows  from  [7,  Lemma 

2.1], 

If  there  is  a  unique  entry  qi^  =  mini<i<„  qi,  then  there  is  a  neighborhood  Mq  of 
q  such  that  for  any  p  G  J\fq,  {i  \pi  =  mini<j<„pj}  =  {i  \qi  =  mini<j<„  qj}.  Let 

(Ti  =  min  min  p,,  do  =  minjO,  min  min  pA  and  e  =  mini - ^ — ^,1|. 

p£-^g  l<i<n  l<3<n  1  —  (J2 

Then  for  any  e  G  (0,£),  the  strictly  complementarity  condition  holds  at  z^{p)  for  any 
p  G  Afq.  Using  [7,  Lemma  2.1]  again,  we  find  that  z®  is  differentiable  at  p  and  the 
derivative  Vz®  in  (2.11).  Hence,  z®  is  a  linear  mapping  on  Mq.  □ 

Remark.  For  any  fixed  e  >  0,  is  positive  definite.  Hence  for  any  q,  the 
LCP(g,  M^)  has  a  unique  solution  z^{q)  which  defines  a  globally  Lipschitz  contin¬ 
uous  function  z^  on  1R”“''^  [6,  8].  Moreover,  by  [7,  Theorem  2.1],  we  know  that  1/e 
is  a  Lipschitz  constant  of  the  solution  function  z®.  The  solution  function  s^{q)  can 
be  considered  as  a  smoothing  function  of  the  indicator  function  l(o,oo)('w)  for  any 
q  =  (— u,  1).  To  illustrate  this,  we  consider  the  LCP  (1.6)  with  n  =  1.  Then,  the 
(first)  s®  component  of  the  solution  of  LCP((7,  is 

f  (1 -I- e'u)/(l -I- e^)  ifu>e, 

s®(g)  =  <  u/e  ifuG(0,  e], 

[  0  ifu  <  0, 

It  is  worth  noting  that  for  any  fixed  rt, 

.n  /  \  1-  e/  ^  f  1  if  u  >  0, 

l(o.^)(u)=hm,,os  (<?)  =  !  0  otherwise. 

Moreover,  the  solution  z^{q)  of  the  regularized  LCP  can  be  used  for  the  set- valued 
constraints.  In  particular,  when  n  =  1, 

(2.12)  Lim„^o.e4,oS®(9)  =  [0,1]  and  lim^^o.eto  s® (<?)  =  |  q 

Continuous  approximation  functions  have  been  used  to  approximate  the  indicator 
function  in  the  study  of  chance  constraints  [11,  12,  16] 

Prob{c(|,a:)  <  0}  =  E[l(_oo.o)c(l,  a;)]  <  a, 

where  c  :  S  x  — >■  IR  and  a  G  (0,1].  However,  these  continuous  approximation 

functions  cannot  easily  be  implemented  to  the  vector- valued  constraints  case  [10,  14], 

Prob{cj(^,a:)  =  mjM  Ci(^,a;)}  =  E[l{„iaxi<,<„  a;)]  =  bj,  j  =  l,...,n, 

Cj  :  E  X  IR*^  — >•  IR  and  bj  G  (0, 1],  j  =  1, . . . ,  n.  The  LCP  approach  and  its  solution 
z®(g)  of  the  regularized  LCP  has  the  ability  to  deal  with  vector- valued  constraints. 

3.  Convergence  analysis  of  the  SAA  regularized  problem.  In  this  section, 
we  study  the  convergence  of  the  SAA  regularized  method.  The  objective  function  of 


9 


all  three  problems  (1.4),  (1.8)  and  (1.9)  is  f{x)  =  ^{x,  Hx)  +  (c,  x),  their  feasible  sets, 

D  =  {x&X\  AE[^t(l,a:)]  9  t  =  l,...,r}, 

=  {x  G  X  I  |lAtE[sf(|,a;)]  -  ht\\  <  r{e),  t  = 

D%  =  {xGX\  -btW  <fie,N),  t=l,...,T}, 

and  their  solution  sets, 

X*  =  argmin^,  /,  =  argmin^.^  /,  X%  =  argmin^ij^  /. 

=  {y\  lly|l  <  always  denote  an  open  ball  centered  at  0  with  radius  £  (in  IR" 

or  H^)  and  Eg  the  corresponding  closed  ball. 

In  Subsection  3.1,  we  derive  the  convergence  of  X®  to  X*  as  e  |  0,  in  Subsection 
3.2  we  obtain  the  convergence  of  Xf^  to  X®  for  any  fixed  £  >  0  as  X  — >■  oo  and 
proceed  to  deduce  the  convergence  of  the  solutions  of  the  SAA  regularized  problems 
by  showing  the  convergence  of  X^  to  X*  as  £  I  0  and  X  — >•  oo. 

Denote  by  d{v,U)  =  inf„g(7  ||u  —  u||  the  distance  from  ri  to  a  set  [/  C  IR”  and 
for  U,V  C  IR”,  the  excess  distance  of  the  set  U  on  V  and  the  Pompeiu-Hausdorff 
distance  between  U  and  V  by 

e(R,  U)  =  sup„gy  d{v,  U)  and  lh(17,  V)  =  max  (e(R,  U),  e{U,  R)). 

3.1.  Problems  (1.4)  and  (1.8).  Here,  we  show  the  convergence  of  X®  to  X* 
as  £  4,  0.  For  simplicity’s  sake,  in  this  section  and  next  one,  we  drop  the  index  t  and 
set  A  =  At,  S  =  St  and  so  on. 

Remember  that  the  solution  set  {z'^(^,x)}  =  SOL(g(^,  x),  M®)  is  a  singleton  and 
the  solution  set  Z^{^,x)  =  SOL(q{^,  x),  M)  is  convex  and  bounded  for  any  {^,x).  By 
Theorem  2.3,  for  every  (^,x),  one  has 

lim||z®(C,x)  -  z°(C,a;)||  =  0, 

£4-0 

where  z^(^,x)  is  the  least-norm  solution  of  the  LCP(q(^,  x),  M),  implying  the  point- 
wise  convergence 

(3.1)  lime^o  d(z^(^,  x),  Z°(^,  x))  =  0. 

However,  from  our  Remark  at  the  end  of  the  previous  section,  we  already  know  that 
for  some  particular  choices  of  Sk  i  0,  — >■  x,  z^'‘{^,x^)  may  not  converge  to  the 
least-norm  solution  of  LCP(g(^,  a;),  M).  Our  predominant  motivation,  however,  is  to 
show  that  the  solutions  of  the  approximating  problems  converge  to  the  solutions  of 
the  given  problem  and,  in  the  process,  establish  the  convergence  of  the  feasible  sets 

and  solution  sets  X^  to  D  and  X*.  To  do  this,  we  are  naturally  led  to  study 
of  the  graphical  convergence  of  the  functions  z'^  as  e  ].  0  rather  than  their  pointwise 
convergence. 

In  first  part  of  the  arguments  that  follow,  ^  remains  fixed  and  thus  it  will  be 
convenient  to  usually  ignore  the  dependence,  on  of  the  functions  u,  q  and  the  asso¬ 
ciated  solutions  functions  2^  =  (s®,7®)  and  the  solution  set  Z^,  only  the  dependence 
on  the  pair  {x,e)  is  relevant. 
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First,  we  review  the  definition  of  graphical  convergence  [15,  Definition  5.32]  of 
the  function  z®  as  £  0.  Let  N  =  {1,  2 ... }  be  the  set  of  natural  numbers,  = 

{all  subsequences  of  N  }  and  Noo  =  (all  indexes  >  some  k}.  We  use  {x^,ek) 

{x,  0)  to  denote  £fc  {.  0  and  x^  ^  x  when  k  G  N. 

Definition  3.1.  For  the  mappings  z®  :  X  — >■  1R"“''^,  the  graphical  outer  limit, 
denoted  by  g-limsup,,  :  X  is  the  mapping  having  as  its  graph  the  set 

Limsupg  gph  z® ; 

g-limsupgZ®(a:)  =  {z|37V  G  A/"#,  (x'",  £fc) (x,  0),  z®*’ (x'') z}. 

The  graphical  inner  limit,  denoted  by  g-liminf^  z®  is  the  mapping  having  as  its  graph 
the  set  Liminfg  gph  z*^ ; 

g-limin4z®(a:)  =  {z|3fV  G  Afoo,  (a;'",  £fc) (x,  0),  z'^'”  (a;'=) z}. 

If  the  outer  and  inner  limits  coincide,  the  graphical  limit  g-lim^  z®  exists  and,  thus, 
=  g-lim^  z®  if  and  only  if 

g-limsupg  z®  C  C  g-liminf  z® 


and  one  writes  ^  ;  the  mappings  are  said  to  converge  graphically  to  Z^ . 

Theorem  3.2.  If,  given  x  i-G-  u{f,,x)  is  continuous  on  X  then,  g-limsup^s^  C 
as  well  as  g-limsup^  z®  C  Z^.  Ifu{f,-)  is  also  surjective,  then  the  functions  s^ 
converge  graphically  to  S^,  that  is, 

(3.2)  s®  — ^  as  well  as  z®  — ^  Z^. 


Proof.  Remember,  throughout  the  proof,  ^  G  S  remains  fixed.  For  a  subsequence 
N  G  M*,  let  (a;^£fc)--  (x,0)  with  Sk  i0,u'^=  q’^  =  (-u^l),  z'^  =  z"'=(g'=) 

and  suppose  z^  ^  z°;  for  any  pair  (^,  x^),  the  vector  z^  is  uniquely  defined,  cf.  Lemma 
2.2.  Moreover,  for  any  Sk  >  0,  LCP(g*,  has  a  unique  solution  z^{f,x^)  = 

(gfc,^efc)  jg  g^igQ  unique  solution  of  the  system  of  (continuous)  equations: 

Min  [z,  M^'^z  +  q^]  =  0, 

where  “Min”  has  to  be  understood  componentwise.  Hence,  with  ,  one  has 

0  =  limfcMin  [z^,  M^z^+g^j  =  Min  [limfeZ^,  lim^  M^z^+g^j  =  Min  [z°,  Mz°+g(^,x)] 

which  means  z°  G  Z^  and  consequently  g-limsupj,  z^  C  Z^  and,  in  particular,  the 
same  applies  to  the  first  n-entries  of  the  z^  and  z°,  i.e.,  s°  G  5”°  D  g-limsupj,{s^}. 

We  now  concern  ourselves  with  the  second  assertion  of  the  lemma.  For  x  G  X, 
let  z(a;)  =  [s{x),j{x))  G  Z^{^,x).  We  need  to  show  that  z{x)  G  g-limin^jz^}.  The 
surjective  property  of  u{f,  •)  :  X  — >•  IR"  implies  that  for  any  g^  =  (— 1),  there  is 
x^  G  X  such  that  g^  =  (  —  u{^,x^),  1).  Let  g  =  {—u{f,x),  1),  z  =  z(g)  and  show  that 

(3.3)  3  N  G  Afoo,  {q'^ ,Sk) {q,0),  S  =  z{q). 

Let  Tjo  =  maxi<i<„(ui(^, a;)  =  —qi).  To  prove  (3.3),  we  examine  all  three  cases: 
r?o  >  0,  ?7o  =  0  and  po  <  0. 
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Case  1.  ryo  >  0.  Without  loss  of  generality,  assume 

(3.4)  q^=...  =qj  <:q^^i  =  and  Si{q)  >  . . .  >  Sj{q) 

which  implies 

j 

^Sj(g)  =  l,  Si(g)  >  0,  i  =  1, . . . ,  J  and  Si{q)  =  Q,  i  =  J  +  l,...,n. 

i^l 

Choose  a  sequence  Sk  i  0.  Then,  for  some  A:, 

(3.5)  Vfc  >  fc,  J{qj+i  -  qi)  +  elqj+i  -  Sk  >  0  and  -  qi  >  £k, 

which  implies  rjQ  >  £k-  Let 

qf  =qt-  Xi£k,  withAi  =  (Jsi(g)  -  l)/J,  i  = 
q'^  =q^,i  =  J+l,...,n. 

From  (3.4)  and  qf  =  qi  —  XiSk,  one  obtains 

Qi  <  ■  ■  ■  <  qj  <  qi  +  £kJ~^  <  -??o  +£k  <0- 

Note  that,  since  =0, 

J  ,7 

||(-9'')+||i  >  '^-qz  =  -Jql+£'^X^  =  -Jqi  >m>  £k- 

Now,  apply  Lemma  2.2(a)  to  obtain  the  solution  z^^{q^)  for  k>  k. 

Since  qi  =  ■  ■  ■  =  qj  =  -?7o,  from  <  770,  =  0  and  -J~^  <  Aj  <  0, 

ctj  =  £fc(9l  ~  Xj£k)  —  JXj£k  —  Efc  <  0. 

Moreover,  from  (3.5),  we  obtain 

ttj+i  =  J{qj+1  —  qi)  +  e^qj+i  —  £fc  >  0. 

Using  a*  <  . . .  <  for  fc  >  fc,  yields 

,7  .7 

cr'^  =  =  J91  -  ^  Ai£fc  =  Jgi,  k>k, 

i=l  i=l 

and  for  k  >  k, 

Skf  k\  _  Jqi  ~  {J  ^Diqi  —  Xi£k)  +  £fc  _  JXi  +  £k{qi  —  Aj£fc)  +  1  .  _  1  J 
j^^+4  "  j  +  4 

and 

4'‘(<?^)  =0;  7  =  J  +  1, . . .  ,n. 

When  /c  — >•  00,  sl’‘{q^)  — >■  A^  +  J“^  =  Si(q),  for  i  =  1, . . . ,  J  and  sl’‘{q^)  — >■  0,  for 
7  =  J  +  1, . . .  ,n,  i.e.,  s^'‘{q^)  -)>  s(g). 
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Case  2.  rjo  =  0.  Without  loss  of  generality,  assume 


(3.6)  0  =  qi  =  ...  =  qj  <  Qi,  i  =  J +1,. . .  ,n,  and  Si{q)  >  . . .  >  sj{q) 

which  implies  that 

E.J 

Si{q)  <l,Si{q)  >Q,  i  =  l,...,J  and  Si(g)  =  0,  i  =  J  +  I, . . .  ,n. 

i—1 

Choose  Efc  4.  0  and  let 

qf  = -.Si{q)ek,  i  =  l,...,J  and  qf  =  qt,  i  =  J+l,...,n. 

Since  J2i=i  Si{q)  <  1,  one  has  J2i=ii-qi)  =  SkJ2i=i  ^  and  >  0,i  = 

J  +  1, . . . ,  n.  Now,  apply  Lemma  2.2(b)  to  obtain  the  solution 

s‘l’‘{q'^)  =  {si{q)ek)/ek,  i=l,...,J  and  Si(g)  =  0,  z  =  J  +  l,...,n. 

Obviously,  when  fc  — >■  oo,  s‘l’‘{q^)  — >■  Si{q),  i  =  1, . . .  ,n,  entailing  z®'=(g^)  — >•  z{q). 

Case  3.  ryo  <  0.  In  this  case  z{q)  =  (g^)  =  0  for  g^  =  g  and  >  0. 

Together,  cases  1-3  in  the  second  part  of  the  proof,  yield  C  g  —  limsup^z^. 

Combining  the  two  parts  of  the  proof,  yields  z^  — ^  and  ^  S^.  □ 

Note  that  when  the  set  {j  \  Uj{^,  x)  =  maxi<i<„  Ui{^,  cc))}  is  a  singleton,  then  both  sets 
{s®(^,  a;)}  and  are  singletons.  In  such  a  case,  g-limsupg  s^{^,x)  =  S'°(^,a;). 

Theorem  3.3.  Assume  m  :  S  x  X  — >■  IR"  is  continuous  and  bounded,  then 
e(D®,  T>)  — >■  0  as  £  J,  0. 

Proof.  Let  z®  :  S  x  X  — >■  IR"”'’^  be  the  single  valued  function  and  Z  :  E  x 
X  IR"'*'^  be  the  set-valued  function  such  that  for  any  (^,a:),  z®(^,x)  is  the  unique 
solution  of  LCP(g(^,  x),  M*^)  and  Z{^,x)  is  the  solution  set  of  LCP{q{f,x),M).  By 
Theorem  3.2,  g-limsup^  z®  C  Z*^. 

Let  £fc  i  0  and  x^  G  D^'‘ .  We  establish  that  any  cluster  point,  say  x,  of  {x^},  is  in 
D.  From  the  boundedness  of  g  and  Lemma  2.2,  we  know  that  s®'‘(^,  a;*)  is  bounded. 
Hence, 

(3.7)  hm  E[s"'=(€,a;'=)]  =  E[lim  s"HI,a:'=)]  C  E[S{tx)], 

SkiO  SfctO 

where  the  equality  comes  from  the  Dominated  Convergence  Theorem  and  the  inclusion 
from  Theorem  3.2.  The  sequence  {sk}  being  arbitrary,  (3.7)  implies 

g-limsup^E[s^(|,x)]  C  E[S'(^,a;)]. 

From  x^  G  1?®'=,  x^  G  X,  HE[s^'“  (^,  a;*)]  -I-  B  b,  X  compact  and  [15,  Theorem 

5.37],  one  has  x  €  X  and  HE[S'(4,  a;)]  9  b,  i.e.,  x  €  D  and  e{D^,  D)  — >•  0  as  £  I  0.  □ 

Assumption  1.  For  any  <5  >  0,  there  exists  an  s  >  0  such  that  for  any  e  G  [0,  e], 
nix*  +  Es) 

Theorem  3.4.  Suppose  Assumption  1  holds  and  q  is  bounded.  Then  we  have 
lime;omina;g£)e  f{x)  =  min /(a;) 

x£D 


(3.8) 
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(3.9) 


Limsup  argmin  f{x)  C  argmin/(a;) 

£4-0  xGD'^  xGD 


Proof.  The  objective  function  /  is  a  quadratic  convex  function  and  independent 
of  £.  We  need  only  consider  the  limiting  behavior  of  the  feasible  set  as  e  j,  0. 

Define  a  set-valued  mapping  V  :  [0,£]  ^  IR"  with  V^e)  =  and  T’(O)  = 

D.  Since  for  every  £  G  [0,£],  D®  and  D  are  closed,  2?  is  a  closed- valued  mapping. 
Moreover,  by  Theorem  3.3,  2?  is  outer  semicontinuous  or,  equivalently  [15,  Theorem 
5.7],  gph2?  is  closed. 

Note  that  C  X  for  all  £  >  0  and  X  is  compact.  Hence,  from  Assumption  1, 
we  obtain  the  assertions  (3.8)  and  (3.9)  from  [5,  Proposition  4.4].  □ 

Theorem  3.4  means  that  under  Assumption  1,  the  optimal  value  function  '■= 
mina;g£)=  fix)  is  continuous  at  £  =  0  and  the  optimal  solution  set  X^  is  outer  semi¬ 
continuous  at  £  =  0.  Assumption  1  is  related  to  Robinson’s  constraint  qualification 
and  often  used  in  perturbation  analysis  of  optimization  problem  [5] .  In  the  following, 
we  present  a  sufficient  condition  for  Assumption  1,  and  the  existence  of  solutions  of 
the  MPSLCC  (1.4),  the  regularized  problem  (1.8)  and  its  associated  SAA  problem 

(1.9). 

For  a  fixed  feasible  solution  x  of  problem  (1.4),  let’s  define 

'^i(C)  :=  min  gj(^,i),  cr2(C)  —  minjO,  min  qji^,x)}, 

l<7<n  i<3<n 

and 


Se  :=  U  G  S1ct2(^)  -  cri(^)  >  £(1 -bTo)  or  CTi(C)  >  0}, 

where  tq  :=  —  minjgH{(Ti(^), 0}.  By  the  continuity  of  u,  the  functions  CTi,  a2  and 
(72  —  CTi  are  continuous  on  S.  Note  that  the  measure  PC^o)  =  Pi'^)  and  Pi^e)  is 
continuous  at  £  =  0  when  the  density  function  is  continuous  or  the  support  of  ^  is 
finite,  i.e.,  jSj  is  finite.  Hence  there  is  a  continuous  function  r  on  the  interval  [0,£]  for 
sufficiently  small  £  >  0  such  that 

(3.10)  P(Se)  >  1  —  f(£),  with  limf(£)  =  0. 

£4-0 

Theorem  3.5.  Assume  that  there  exists  a  feasible  solution  x  of  problem  (1-4) 
such  that  AE[s(^,a;)]  =  b  and  z{^,x)  =  {s{£,,x),ji^,x))  is  the  least  norm  solution 
of  the  LCP{qi^,x),M).  Then  problems  (1-4)  cind  (1.8)  are  solvable  with  r(£)  > 
njj  Ajj  (ro£ -I- 2f (£)),  w/iere  tq  =  —  min^gH{(Ji(^),  0}.  Moreover, 

(3.11)  min2;gD  fix)  <  liminf  mina;gDe  fix). 

£4-0 

If  the  feasible  solution  x  is  an  optimal  solution,  then  Assumption  1  holds. 

Proof  For  any  ^  G  S,  the  solution  set  of  the  LCP(<;(^,  i),  M)  is  bounded.  From 
Theorem  3.1.8  in  [8],  the  solution  z^i^,x)  of  the  LCP(g(^,  x),  M*^)  converges  to  the 
least  norm  solution  of  LCP(g(^,  x),  M)  as  £  j,  0. 

To  show  X  G  22®,  we  first  prove  that  for  any  £  G  (0, 1), 

(3.12)  0  <  s®(5,i)  -  s(^,i)  <  (ro£)e,  for  G 
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We  prove  (3.12)  by  consider  two  cases:  cri(^)  <  0  and  cri(^)  >  0. 

Case  1.  cri(^)  <  0. 

Since  cri(^)  <  0,  by  definition  of  (Ti(^)  and  cr2(^)  above,  we  know  that 


^  q-2(g)  -gl(C)  ^  g2(g)  -  0-1  (g) 

“  l+To  “  l-cr2(^) 


VCG 


Let  us  define 

J{0  =  =  and  J(^)  = 

Following  the  proof  of  Theorem  2.3  (See  (2.5)  and  (2.9)),  we  can  show  that  the  solution 
z^{^,x)  of  hCP{q{^,x),  M^)  has  the  following  form 


(3.13) 


zU^,x)  = 


l-£0-l(C) 

0 


if 

if 

if  j  =  n  +  1. 


The  least  norm  solution  s(^,a:)  =  argmin^gg^^  II7/II2  is  the  first  n-components  of  the 
least  norm  solution  of  LCP(g(^,  x),  M®),  which  has  the  form 


Zj{^,x)  = 


Hence,  for  ^  G  we  derive 


7^,  if  J  G  JiO, 

0,  if 

if  j  =  n  +  l. 


For  case  2,  it  is  easy  to  show  that  the  solution  z^{^,x)  of  LCP(q(^,  x),  M^)  has 
the  following  form 

Zji^,x)  =  0,  j  =  1,..  .,n+  1, 

and  it  is  just  the  least  norm  solution  of  LCP(g(^, i), M),  which  means  s®(^,a;)  — 

Si{^,x)  =  0. 

Combining  cases  1  and  2,  we  have  (3.12). 

Now,  for  sufficiently  small  e,  we  consider  the  expected  value 

|E[s®(|,x)  -  s(|,i)]| 

<  (roe  +  2f(e))e, 

where  the  last  inequality  uses  the  explicit  form  s®(^,  x)  in  Lemma  2.2,  and  (3.10)  with 
0  <  s^(C)  <  2e,  0  <  s(^,  x)  <  e  and 

|s®(C,:r)  -  s{^,x)\  <  max{s^(^,i),s(C,x)}  <  2e. 
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Hence,  we  have 

||HE[s®(|,i)]  -  &II  =  ||HE[s®(|,x)  -  s(|,x)]||  <  ||H||||e||(ro£  +  2r(s))  <  r{e), 
which  implies  that  x  €  . 

Since  problems  (1.4)  and  (1.8)  have  the  same  objective  function  that  is  continuous, 
the  feasibility  of  the  two  problems  implies  their  solvability. 

If  X  G  X*,  then  Assumption  1  holds  from  x  G  H®.  □ 

Remark.  The  set-valued  constraints  in  (1.2)  can  also  be  approximated  by  a  sequence 
of  equality  constraints  via  regularized  quadratic  programs  with  unique  solutions  for 
fixed  £  >  0: 


maxj^(?/,  u)  -I-  £(y,  y)  subject  to  (e,  y)  <  1,  y  >  0. 

However,  the  solution  of  the  KKT-conditions  is  not  unique  and  the  peremptory  results 
can’t  be  derived  from  the  ‘regularized’  system 

Min  [  z,  M^z  +  q{^,  x)  ]  =  0, 

-  /  £)/  6  \  .  .  . 

where  =  I  ^  ^  1  is  positive  semi-definite  and  /  is  n  x  n  identity  matrix.  The 

novel  idea  in  Theorem  3.2  is  that  we  use  the  well-established  theory  for  monotone  LCP 
to  derive  the  required  properties  of  the  regularized  solution  of  and,  in  particular, 
its  first  n-components  s®. 

3.2.  Problems  (1.4)  and  (1.9).  In  this  subsection,  we  consider  the  convergence 
of  the  solution  set  of  (1.9)  to  the  solution  set  X*  of  problem  (1.4)  as  £  j,  0  and 
N  — >■  oo.  First,  we  consider  the  convergence  of  the  solution  set  of  problem  (1.9) 
to  the  solution  set  X®  of  problem  (1.8)  as  — >■  oo  for  a  fixed  £  >  0.  Next,  we  use 
this  convergence  result  with  Theorem  3.4  to  derive  the  convergence  of  X^  to  X*  as 
£  I  0  and  N  ^  oo. 

Let  Ve  and  be  the  optimal  values  of  problems  (1.8)  and  (1.9). 

Assumption  2.  There  exists  a  measurable  function  C  :  S  — >■  (0, -l-oo)  such  that 
E[C'(4)^]  <  oo  and 

||m(^,x)  -  u{^,x)\\  <  C'(^)||x  -  x|| 

for  all  x,x  €  X  and  P-almost  every  C  G  2. 

Proposition  3.6.  Let  f{e,  N)  ■.=  r{£)+cN~'^ ,  where  t  G  (0, 1)  and  c  is  a  positive 
constant.  Suppose  that  the  samples  are  iid  and  Assumption  2  holds.  Moreover,  there 
is  rj  such  that  ||(t6(^,  x))+||i  <  ij  for  x  G  AT,  ^  G  S.  Then  there  exists  an  e  >  0  such 
that  the  following  statements  hold  for  any  e  G  (0,  e]  . 

(i)  For  N  sufficiently  large,  C  Df^; 

(a)  For  any  A  >  0  there  exists  a  sufficiently  large  such  that  E(I1®,Z1|^)  <  A 
holds  w.p.l  for  N  >  N/\; 

(Hi)  vfi  — >■  Vg  and  e(A^,  A®)  — >■  0  w.p.l  as  N  ^  oo. 

Proof  (i)  Since  A  is  a  compact  subset  of  IR^,  by  the  continuity  of  u{^,  •),  •)  is 

globally  Lipschitz  continuous  on  A  for  almost  every  ^  G  S.  Moreover,  by  Lemma  2.2, 


16 


oil  ^  l+E''?-  Then  by  the  classical  uniform  law  of  large  numbers  ([17,  Proposition 
7,  Section  6]),  we  have  ^  E[s®(^,a;)]  uniformly  w.p.l  as  iV  — >•  oo. 

By  the  Remark  following  Theorem  2.4  and  Assumption  2, 

||s®(C,a;)  -  s^(^,x)||  <  -|lu(^,a:) -u(^,x)||  <  -C'(^)||a;-x|| 

£  e 

and  E[C'(^)^]  <  oo.  Moreover,  for  all  ^  G  S,  s'^(^,x)  is  uniformly  bounded.  Then 
the  mean  and  variance  of  random  variables  s®(^,  a;)  are  finite  for  all  x  G  X.  By  [17, 
Chapter  6]  and  the  functional  central  limit  theorem  [2,  Corollary  7.17], 

1  ^  1 

-^s^(f,x)-E[s^(^,x)]  =Op(^). 

By  Assumption  1,  ^  0.  Then  for  all  x  G  D^,  there  exists  sufficiently  large  Nq, 

such  that,  when  N  >  Nq, 

(3.14) 

-  AE[s^^,x)]+ AE[s%^,x)]-b 

<  -^E[s®(C,x)]  +r(£) 

<  cN~'^  +  r{e) 

=  f{s,N) 

w.p.l,  which  implies  that  x  G  w.p.l. 

(ii)  Let  A  >  0  and 

{xeX:d{x,D'^)>A} 

By  the  compactness  of  X  and  the  continuity  of  s^(^,  •),  we  have  S{A)  >  0. 

Let  Aa  be  sufficiently  large  such  that 

sup 

xex 

and  cN~'^  <  For  any  point  x  G  X  with  d{x,D^)  >  A,  we  have 

||AE[s®(^,a;)]  -  &||  >  r{e)  +  (5(A), 

which  implies 

>  ||AE[s''(^,a:)]  -  6||  -  s®(Cbx)  -  AE[s''(^,a;)] 

>  r(e)  +  5(A)-^ 

>  r{£)  +  cN~'^ 

=  f{£,N). 

This  shows  that  x  ^  Hence  for  any  x  G  d{x,  D’^)  <  A,  which  implies 

<  A. 
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Combining  the  above  result  with  Part  (i),  we  have  h{D^,  <  A  w.p.l  for  N  >  Nq. 

(iii)  We  apply  [5,  Proposition  4.4]  to  prove  this  part. 

Since  problems  (1.8)  and  (1.9)  have  the  same  convex  quadratic  objective  function 
which  is  independent  of  e  and  we  only  need  to  consider  the  limit  behavior  of  the 
feasible  set  as  A  — >•  oo.  Let 

1  ^ 

G,{x,  N)  :=  \\A-  -  ^11  - 

Since  ^  E[s'^(^,a:)]  uniformly  on  X  w.p.l  as  A  — >•  oo,  Gs{x,N)  — >• 

||^E[s®(^, a;)]  —  5||  —  r(s)  as  A  — >■  oo  uniformly  on  X  w.p.l  and  continuous  w.r.t. 
X  £  X.  Hence  for  any  x  £  X, 

limjv^oo.x^x  Geix,  A)  =  ||HE[s''(^,  x)]  -  6||  -  r{e), 

which  implies  that  the  feasible  set  map  with  respect  to  A  is  closed  P-a.s.for 
sufficiently  large  A.  By  part  (i)  of  this  proposition,  A®  C  X  and  C  X  are 
nonempty  for  sufficiently  large  A.  Moreover,  from  part  (ii)  of  this  proposition,  we 
have  E(A®,  A^)  — >■  0  which  implies  that  for  any  neighborhood  Vjfe  of  A®,  there  exists 
a  sufficiently  large  Aq  such  that  for  all  A  >  Aq,  Vx^  H  A|^  ^  0.  Hence  all  conditions 
of  [5,  Prpposition  4.4]  are  satisfied,  and  thus  we  derive  v%  -£  Vg  and  e(A^,  A^)  — >•  0. 
□ 

The  proof  of  part  (ii)  of  Proposition  3.6  is  motivated  by  the  proof  of  [18,  Lemma 
4.2  (i)]. 

Now,  we  are  ready  to  present  the  convergence  of  Xf^  to  A*  as  e  j,  0  and  A  — >•  oo. 

Theorem  3.7.  Suppose  the  conditions  of  Theorem  S.f  and  Proposition  3.6  hold. 
If  the  feasible  set  A  is  nonempty,  then  Xff  is  nonempty  and 

(3.16)  lim  lim  e(A^,A*)=0  a.s. 

£4-0  N—^OO 


Proof.  Since, 

lim  lim  e(A^,  A*)  <  lim  lim  e(A^,A®)+lim  lim  e(A£,A*) 

e4.0  AT-s-oo  £4.0  N^oo  e4.0  AT-s-oo 

=  limO  +  lime(Ae,  A*)  w.p.l 
£4'0  e-i-O 

=  0  w.p.l, 

the  assertion  now  follows  directly  from  Theorem  3.4  and  Proposition  3.6.  □ 

4.  The  pure  characteristics  demand  model.  One  important  application  of 
problem  (1.1)  is  to  estimate  the  parameters  of  the  pure  characteristics  demand  model 
proposed  by  Berry  and  Pakes  [3].  Although  the  model  has  several  advantages  in 
describing  markets,  it  faces  serious  challenges  and  difficulties  in  estimating  some  key 
parameters  when  relying  on  the  generalized  method  of  moments  (GMM).  Pang,  Su  and 
Lee  [14]  reformulated  the  GMM  estimation  problem  of  the  pure  characteristics  demand 
model  as  a  computationally  tractable  quadratic  program  with  linear  complementarity 
constraints;  the  reformulated  GMM  estimation  problem  can  be  thought  as  a  special 
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case  of  problem  (1.1).  To  illustrate  our  SAA  regularized  approach  and  the  convergence 
results  established  in  §2  and  §3,  we  consider  an  example  of  the  pure  characteristics 
demand  model: 

•  T  is  the  number  of  markets  and  n  the  number  of  products  in  each  market. 

•  The  utility  function  of  product  j  in  market  t  is: 


(4.1) 


Ut{^,  x)  =  Ct/3(^1,  Xi,  X2)  -  a{^2,  X3)pt  +  X4t, 


where  Cjt  G  IR^,  Ct  —  (ck,  . . . ,  Cnt)  G  IR"^^,  xu  G  IR", 

Xi  =  (xfi, . . . ,  xfrp)  G  ]R"^,  0:2, 3:3  G  3:4  G  IR,  a;  =  (3:1, . . . ,  X4)  G  IR^. 
Here  |  =  (li,^2)  :  ^  S  C  IR^  represents  a  consumer  (or,  more  precisely,  a 
consumer’s  behavior),  which  is  described  as  a  random  vector  and  ^2 
independent  and  satisfy  standard  normal  distribution  as  in  [14]. 

(i{^i,X2,X3)  =  X2+ X3^i  and  q:(^2, 2^4)  =  exp(3:4^2)- 

For  product  j  in  market  t,  we  use  Cjt  G  H*”  to  denote  the  K  observed  product 
characteristics,  Pjt  G  IR  denotes  the  observed  price,  and  {xit)j  G  IR  denotes 
the  demand  shock  or  errors  which  is  not  available  in  the  data.  We  assume 
that  A  :=  {3;  :  ^  <  3;  <  3;}  for  given  x,x£  IR"^  and  v  =  2K  +  nT  +  1. 

•  Consumer  ^  chooses  to  purchase  product  j  in  market  t  if  and  only  if 

Ujti^,x)>  max  {Mit(^,3;),0}. 

l<i<n 

•  bt  =  {bjt)]=i  with  bjt  the  observed  market  share  of  product  j  in  market  t. 

The  GMM  estimation  problem  is  aimed  at  finding  optimal  parameters  x  by  minimizing 
the  model  error,  ||3;i|||  subject  to  the  generalized  market  share  equations 

E[S'i(|,3;)]  9  6t,  t  = 

which  can  be  expressed  as  a  quadratic  program  with  stochastic  equilibrium  set- valued 
constraints  in  the  following  form 


(4.2) 


mina;gx  5(3:1, 3:1) 


subject  to  E[5't(4,  x)]  B  bt,  t  =  I,. . . ,  T, 
where  St{^,x)  consists  of  all  the  solutions  of  the  linear  program: 

max  {  {y,  ut(^,  x))  \{e,y)  <l,y>0  }. 

V 

Obviously,  the  GMM  estimation  problem  (4.2)  is  a  special  case  of  problem  (1.4). 
We  can  apply  the  SAA  regularized  method  to  handle  the  problem.  The  convergence 
results  established  in  §3  are  applicable.  Specifically,  the  regularized  problem  of  (4.2) 
is: 


(4.3) 


mina,gx  l{xi,xi) 

subject  to  |1E[4(|,3;)]  -  5(11  <  r(e),  t  = 


Let  {(^(,^2)0  =  I," 
problem  then  reads. 


(4.4) 


mm2,gx 
subject  to 


,N}  he  iid  observations  of  (4i,l2)-  The  SAA  regularized 


5(3:1, 3:1) 

II^Efcl4(?^a;)-5t||  <f(e,iV),  t=  1,...,T, 
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where  (sf(^,x),7f(^,x))  is  the  unique  solution  of  LCP{qt{^,x),  M’^): 

(4.5)  0  <  X  M-(  *)  +  (-“•«•">)  >0 

for  some  7f(^,a;)  G  H.  Let  us  consider  a  particular  case  with  T  =  1,  n  =  2,  if  =  1, 
v  =  5.  For  simplicity’s  sake,  we  omit  t  in  what  follows.  Set  b  =  ^),  c  =  (2,3), 

p  =  (1,2),  To  =  1,  r(e)  =  2to£,  f{e,N)  =  r{e)+N~i ,  £  =  2,  and  ^2  are  independent 
and  satisfy  standard  normal  distribution.  We  choose  Xj  =  —  1,  a;*  =  8,  t  =  1, . . . ,  5  and 
initial  point  Xq  =  (1, 1, 1, 1, 1).  It  is  easy  to  observe  that  there  is  an  optimal  solution 
X*  =  (0, 1, 0, 0,  0)  at  which  the  optimal  value  is  0,  since 

l3i^i,X2,xl)  =  X2  +X3C1  =  1,  a{^2,xl)  =  exp(x4^2)  =  1, 


and 


X*)  =  c/3(^i,  X2,  X3)  -  a{^2,  xl)p  +  X4  =  (1, 1), 

which  implies  the  solution  set  of  (1.5)  is  S'(^,x*)  =  {(A,  1  —  A)  |  0  <  A  <  1}  for  all 
^  G  S.  Especially,  the  constraint  E[s(4,x*)]  =  b  holds  with  the  least  norm  solution 

X*)  =  (s(C, X*),  7(?, X*))  =  (1/2, 1/2, 1). 

Moreover,  using  this  optimal  solution  x*  as  a  feasible  solution  for  defining  f(e)  in 
(3.10),  we  obtain  f(e)  =  0  and  r(e)  =  2e  in  Theorem  3.5.  Hence,  by  Theorem  3.5  and 
Proposition  3.6,  problems  (4.3)  and  (4.4)  are  solvable  and  Assumption  1  holds  at  x* . 
The  conditions  of  Theorem  3.7  are  satisfied  which  means  our  convergence  results  hold 
for  this  problem. 

The  tests  were  carried  out  in  MATLAB  8.0  installed  on  a  IBM  Notebook  PC 
with  Windows  7  operating  system,  Intel  Core  i5  processor.  We  used  the  Matlab 
solver  ’’fmincon”  to  solve  problem  (4.4)  with  different  values  of  £  and  N ,  where  the 
closed  form  of  s^(^bx)  derived  in  Lemma  2.2  has  been  used  in  our  calculations. 
We  report  numerical  result  for  e  =  0.2,0.1,0.05  and  N  =  500,800,1100,1400.  For 
each  combination  of  e  and  N,  35  independent  test  cases  were  carried  out,  each  of 
which  solves  the  SAA  regularized  problem  and  yields  an  approximating  solution  x^. 
Moreover,  we  use 


error(x^)  =  ^  ^  s*(r,  x^)  -  5|| 

to  measure  the  infeasibility  of  x%  with  a  large  sample  size  Nq  =  10000  >  N ,  where 
z*(^,x^)  =  (s*(^,  x|^),  7*(^,  x|^))  is  the  least  norm  solution  of  the  LCP  (1.5).  Table 
4.1  presents  the  means  of  errors  of  the  approximation  solutions  and  the  means  of 
the  optimal  values  of  problem  (4.4).  The  table  shows  the  downward  trend  of  the 
errors  when  the  value  of  e  gets  smaller  and  the  sample  size  N  increases  and  that  the 
approximation  optimal  values  are  almost  0.  In  Figures  4. 1-4.3,  we  use  ’’boxplot”  in 
Matlab  to  show  the  convergence  trend  of  the  error  when  the  sample  size  N  increases. 
Each  box  in  the  figures  displays  the  range  of  errors  of  the  computed  solutions  generated 
from  35  independent  tests,  where  the  central  mark  is  the  median  and  the  edges  of  the 
box  are  the  25th  and  75th  percentiles. 
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Table  4.1 

The  means  of  errors  and  optimal  values  with  different  e  and  sample  size 


N 

e 

500 

800 

1100 

1400 

error 

fval 

error 

fval 

error 

fval 

error 

fval 

0.2 

0.0418 

0.0005 

0.0327 

0.0000 

0.0319 

0.0000 

0.0273 

0.0003 

0.1 

0.0349 

0.0004 

0.0291 

0.0005 

0.0278 

0.0002 

0.0244 

0.0010 

0.05 

0.0342 

0.0012 

0.0248 

0.0008 

0.0255 

0.0007 

0.0234 

0.0007 

Sample  Size  N 


Fig.  4.1.  error(x^j^)  when  e  =  0.2. 


5.  Concluding  remarks.  Mathematical  programs  with  set-valued  stochastic 
equilibrium  constraints  (1.1)  provide  a  powerful  modeling  paradigm  for  many  impor¬ 
tant  applications,  in  particular,  in  economics.  For  example,  for  the  estimation  of  pure 
characteristics  demand  models  with  pricing.  However,  existing  optimization  methods 
with  the  sample  average  approximation  become  intractable  for  solving  such  problems. 
Recently,  Pang  et  al.  [14]  proposed  a  mathematical  programming  with  linear  comple¬ 
mentarity  constraints  (MPLCC)  approach  for  the  pure  characteristics  demand  model 
with  a  finite  number  of  observations.  Their  approach  provides  a  promising  computa¬ 
tional  method  to  estimate  the  consumer  utility  under  the  following  condition: 

Condition  1  In  any  market  t,  the  optimal  choice  of  each  individual  consumer  is 
guaranteed  to  purchase  just  one  single  product  in  each  ^-environment. 

Condition  1  and  the  use  of  a  corresponding  basic  solution  with  a  finite  number  of 
observations  can  be  expresses  in  terms  of  mathematical  program  with  linear  equilibri¬ 
um  constraints  (1.3).  This  paper  is  motivated  by  the  MPLCC  reformulation  proposed 
by  Pang  et  al  [14].  Our  main  contributions  are  as  follows. 

(i)  Remove  Condition  1.  We  believe  removing  Condition  1  is  important  for  re¬ 
al  applications  in  economic.  Consider  just  a  simple  case  with  one  market  and  two 
products.  If  the  value  of  utility  function  of  the  consumer  for  the  two  products  satisfy 
ui(^,x)  =  U2{^,x)  >  0,  the  probability  that  the  consumer  buy  the  two  product- 
s  described  as  a  solution  si(^,a;)  and  S2(Ci*)  of  (1-2)  satisfy  si(^,  a:),  52(^1 2;)  >  0, 
■si(^!a^)  +  S2{^iX)  =  1.  Under  Condition  1,  the  consumer  should  buy  just  one  single 
product.  Which  solution  should  the  consumer  choose  with  probability  one?  If  we 
consider  si(^,a:)  and  S2{^,x)  as  the  probability  that  the  consumer  buy  the  product- 
s,  then  the  answer  is  most  likely  si(^,a:)  =  S2{^,x)  =  which  is  the  least  norm 
solution  of  (1.5).  Using  graphical  convergence  for  set-valued  mappings  [15],  we  can 
remove  Condition  1. 

(ii)  Develop  the  SAA  regularized  method.  To  handle  the  set-valued  mapping  in 
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Sample  Size  N 


Fig.  4.2.  error(x^j^)  when  e  =  0.1. 


Sample  Size  N 


Fig.  4.3.  error(xp^)  when  e  =  0.05. 


(1.1),  we  develop  an  efficient  SAA  regularized  method  using  (1.8)  and  (1.9)  which 
replaces  the  set-valued  mapping  by  a  single  valued  function.  Problem  (1.9)  is  a  math¬ 
ematical  program  with  a  convex  quadratic  objective  function  and  globally  Lipschitz 
continuous  inequality  constraints.  Moreover,  we  derive  a  closed  form  of  the  solution  of 
the  regularized  LCP((7,  M^),  which  is  useful  for  numerical  computation  and  theoretical 
analysis.  We  show  that  a  sequence  of  solutions  of  the  SAA  regularized  stochastic 
MPSLCC  (1.9)  converges  to  a  solution  of  problem  (1.4)  as  e  j,  0  and  N  ^  oo. 
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